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IS.  ABSTRACT 


A  theory  of  search  in  the  presence  of  false  contacts  that  are  generated  by  real 
objects  was  developed  by  Stone  and  Stanshine,  "Optimal  Search  Using  Uninterrupted 
Contact  Investigation",  SIAM  J.  of  Appl.  Math.  20  (1971),  pp.  241-263.  Although 
they  assume  that  false  targets  will  be  marked,  when  found,  so  that  they  will  not 
be  investigated  again  should  they  be  contacted  again,  no  use  is  made  of  the  known 
number  of  found  false  targets.  The  search  plans  that  they  obtain  with  their  ex¬ 
pected-value  model  are  not  optimal  when  all  available  information  is  used. 

In  this  paper  we  formulate  the  search  problem,  assuming  that  the  information  on 
the  number  and  location  of  found  false  targets  is  available  and  will  be  used  to 
the  maximum  extent  possible.  We  show  that  the  resulting  formulation  differs  sig¬ 
nificantly  from  that  of  Stone  and  Stanshine.  The  optimization  problem  is  more 
difficult.  The  solution  is  outlined  for  the  case  in  which  the  number  n  of  false 
targets  is  known  or  has  a  known  finite  distribution.  An  example  with  n  =  1  is 
solved  completely.  The  problem  has  not  been  solved  for  distributions  that  are 
not  finite,  such  as  the  Poisson  distribution. 
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SEARCH  WHEN  FALSE  CONTACTS  ARE  GENERATED  15 Y  REAL  OBJECTS 


1 .  lilt  roduct  ion  and  Summary 

The  first  serious  attempt  to  develop  a  theory  of  search  in  the  presence 
of  false  targets  is  that  of  Stone  and  Slanshine  [1].  They  assume  that 
false  contacts  are  generated  by  real  objects  that  can  be  marked,  when 
located  and  identified,  so  that  they  will  not  require  investigation 
should  they  be  contacted  again.  They  use  an  expected-value  model  for 
the  number  of  found  false  targets.  They  make  no  reference  to  (and, 
hence,  no  use  of)  the  information  afforded  by  the  known  number  of  false 
targets  that  have  been  found  by  a  given  search  time. 

It  seems  reasonable  to  assume  that  the  searcher  will  record  the  number, 
as  well  as  the  locations,  of  found  false  targets  in  a  search  for  sub¬ 
merged  submarines  and  in  most  search  situations  of  interest.  This 
information  can  be  used  to  improve  the  search  plan  under  most  conditions, 
including  those  assumed  by  Stone  and  Stanshine.  Hence,  we  believe  that 
the  Stone  and  Stanshine  formulation  of  the  problem  is  incorrect. 

In  this  report  we  formulate  the  search  problem  in  the  presence  of  false 
targets,  assuming  that  the  information  on  the  number  of  found  false 
targets  is  available.  We  start  with  the  case  in  which  the  initial  num¬ 
ber  of  false  targets  is  known,  and  then  consider  the  case  in  which  the 
number  is  unknown  but  the  number  distribution  is  known.  We  exhibit 
examples  for  both  cases  to  show  that  by  using  the  information  on  the 
number  of  found  false  targets  we  can  find  a  search  plan  that  yields  a 
smaller  expected  time  to  detection  than  that  obtained  with  the  optimal 
solutions  that  do  not  use  the  information,  including  the  Poisson  distri¬ 
bution  assumed  by  Stone  and  Stanshine. 

The  changes  in  the  formulation  of  the  problem,  required  by  the  assump¬ 
tion  that  the  number  of  found  false  targets  is  known,  produce  an  optimi¬ 
zation  problem  that  is  considerably  more  difficult  than  the  optimization 
problem  of  Stone  and  Stanshine.  When  the  initial  number  of  false  targets 
is  known  or  has  a  finite  distribution  the  solution  can  be  obtained  in  a 
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finite  number  of  steps  by  Dynamic  l’ rug ramming.  At  each  step  we  have  a 
functional  to  optimize;  we  use  methods  from  the  Calculus  of  Variations, 
but  other  methods  could  be  used.  The  solution  is  outlined,  and  demon¬ 
strated  for  a  few  examples. 

T'lie  optimization  problem  for  a  non-finite  distribution,  such  as  the 
Poisson,  appears  to  be  essentially  more  difficult  than  the  problem  for 
a  finite  distribution.  We  have  not  solved  this  problem,  although  it 
is  likely  that  it  can  be  solved  by  an  extension  of  the  method  that  we 
used  for  the  finite  distribution. 

2 .  Target  and  False  Target  Number  Distributions 

We  assume  that  exactly  one  target  is  known  to  be  in  a  region  R  of 
Euclidean  n-space,  with  known  location  density  function  f(x).  During 
the  search,  false  contacts  may  be  generated  by  other  real  objects  in  R, 
called  false  targets,  which  can't  be  distinguished  from  the  target  except 
by  a  close  inspection.  The  number  of  false  targets  in  R  may  be  known, 
or  unknown  with  a  known  number  density  function.  We  assume  that  the 
false  targets  are  independently  distributed  with  known  location  density 
functions.  They  may  be  identically  distributed  with  common  location 
density  function  g(x),  or  otherwise.  Our  assumptions  on  the  number  dis¬ 
tributions  are  more  general  than  those  of  Stone  and  Stanshine,  who  limit 
consideration  to  the  Poisson  distribution.  On  the  other  hand,  our  as¬ 
sumptions  on  the  location  distributions  are  more  specific;  Stone  and 
Stanshine  introduce  the  collective  density  function  6  (x) ,  but  say  nothing 
about  the  individual  density  functions. 

If  a  contact  is  made,  the  search  will  be  interrupted,  an  investigation 
will  be  started,  and  continued  until  the  contact  has  been  identified. 

If  the  contact  is  the  target,  the  search  will  be  stopped.  If  the  contact 
is  a  false  target,  its  location  will  be  recorded  and  the  position  marked, 
perhaps  with  a  buoy,  so  that  another  investigation  will  not  be  made, 
should  it  be  contacted  again.  Then  search  will  be  resumed. 

When  an  investigation  of  a  contact  has  been  completed  a  change  occurs 
in  one  of  the  number  distributions.  If  the  contact  is  the  target,  the 
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number  of  unlocated  targets  in  R  changes  from  one  to  zero.  We  use  this 
information  to  adjust  our  searcti  procedure:  we  stop  the  search.  Simi¬ 
larly,  if  the  contact  is  a  false  target,  we  use  this  information  to 
adjust  our  search  procedure. 

If  the  number  of  false  targets  in  R  is  a  known  number  n,  the  number  of 
residual  (unlocated)  false  targets  in  R  is  n  -  1.  Hence,  we  resume  the 
search  under  the  condition  that  there  now  are  n  -  1  false  targets.  As 
additional  contacts  are  made,  investigated,  and  found  to  be  false  tar¬ 
gets,  we  reduce  the  number  of  residual  false  targets.  Finally,  if  we 
are  unlucky  and  persevere  long  enough,  all  the  false  targets  will  have 
been  located  and  we  then  continue  the  search  under  the  assumption  that 
there  are  no  false  targets  in  R. 


If  the  number  n  of  false  targets  in  R  is  unknown  with  a  known  distribu¬ 
tion,  let 

p,  =  Prob.  {n  =  k} 
k 

When  a  contact  has  been  made,  investigated,  and  found  to  be  false,  we 
now  know  that  there  is  at  least  one  false  target  in  R.  If  the  found 
false  target  is  eliminated  by  marking  its  location,  the  probability 
that  there  are  k  false  targets  unlocated  in  R  is 

pk(1>  '  pk+l/(1  -P„>  .  *  -  0,  1,  2.  ••• 

Continuing  in  this  way,  the  probability  that  there  are  k  residual  false 
targets  in  R,  given  that  i  false  targets  have  been  located,  is 

pkU)  =  pk+i/(1  '  po  '  pi  '  ’  Pi-1)>  k  =  °»  lf  2#  •**  (1) 


If  we  assume  that  the  found  false  targets  are  not  marked  and  eliminated 
from  the  residual  population,  the  probability  that  there  are  k  false 
targets  in  R,  given  that  i  false  targets  have  been  located,  is 


P 


k 


(i) 


0  ,  k  =  0,  1,  2 . i  -  1 

Pk/(1  "  P0  "  P1  "  *•*  "  Pi-1)’  k  =  i»  1  +  "• 


(2) 
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Our  formulation  admits  either  equation  (1)  or  equation  (2).  We  will 
use  equat ion  (1 ) . 

The  known  fact  that  i  false  targets  have  been  found  is  a  condition  on 
the  false  target  distribution  in  the  (i  +  l)St  stage.  The  number  proba¬ 
bility  density  function  is  conditional  on  i ,  as  noted  above.  Also,  the 
location  density  function  of  the  residual  false  targets  may  be  condi¬ 
tional  on  i  and  on  the  known  locations  of  the  found  false  targets.  it 
is  for  this  reason  that  we  need  to  specify  the  individual  density  func¬ 
tions,  in  addition  to  the  collective  density  function. 


If  the  false  targets  are  identically,  and  independently,  distributed,  the 
common  location  distribution  of  the  residual  false  targets  does  not  de¬ 
pend  on  i  and  the  locations  of  the  i  found  false  targets.  In  this  case, 
the  collective  density  function  is  sufficient.  The  individual  density 
function  can  be  obtained  from  the  collective  density  function,  and  con¬ 
versely. 


If  the  false  targets  are  not  identically  distributed,  the  number  and 
locations  of  the  found  false  targets  have  an  effect  on  the  location 
distributions  of  the  residual  false  targets.  The  posterior  density  of 
false  targets  depends  on  the  amount  of  information  that  is  available  from 
the  location  of  the  found  false  targets.  Thus,  if  we  know  there  are  ex¬ 
actly  n^  false  targets  in  region  I  and  exactly  n^  false  targets  in  region 
II  of  two  disjoint  regions,  the  residual  numbers  of  false  targets  in  the 
two  regions,  given  that  i  have  been  located  in  region  I  and  i^  in  region 
II,  are  known  precisely.  If  the  probability  that  a  found  false  target 
has  a  particular  distribution  depends  only  on  the  relative  density,  the 
probability  r^ (x^)  that  a  found  false  target  is  of  distribution  type  j, 


given  that  it  was  found  at  x^,  is 


r.(xi)  =  (x1)/6(x1) 


(3) 


where 


<5^(x)  =  collective  density  of  false  targets  of  type  j, 

6(x)  *  S  6  (x)  =  total  collective  density  of  false  targets 

(j)  j 
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We  then 
targets 
targets 
x^,  the 
targets 


can  use  rj(xj)  aild  equation  (1)  to  obtain  the  number  of  residual 

of  each  type  from  t fie  probabilities  p  that  there  are  k  false 

J  ^ 

of  type  j.  For  example,  if  one  false  target  has  been  located  at 

conditional  probability  p  (x  )  that  there  are  k  residual  false 

jk  1 

of  type  J  is 


pjk(xi)  '  rju 


+  (1  - 


rj(xl)) 


jk 


(A) 


By  repeated  use  of  this  equation  we  can  then  obtain  the  probability  that 
ther.  are  k  residual  false  targets  of  type  j ,  given  that  i  false  targets 
have  been  found  at  x^,  x^ . x^. 


3.  Effort  Distributions  and  Conditional  Detection  Functions 

It  will  be  convenient  to  use  a  notation  that  permits  the  search  density 
function  to  change  each  time  a  false  target  is  found.  Let 

s^  =  search  time  at  which  the  first  contact  is  made, 

y^(x,s)  =  search  density  at  x  by  search  time  s,  0  s  _<  s^. 

If  the  contact  is  a  false  target  and  search  is  resumed,  let 

s^  =  additional  search  time  in  the  second  stage,  measured 

from  the  resumption  of  search  until  a  second  contact 
is  made, 

=  additional  search  density  at  x  by  the  additional 
search  time  s  in  the  second  stage,  0  <_  s  <_  s^. 

In  general,  let 

til 

s^  =  additional  search  time  to  make  a  contact  in  the  i 

stage  of  the  search, 

u  (x,s)  =  additional  search  density  at  x  by  the  additional 
i  th 

search  time  s  in  the  i  stage,  0  s  £  s^. 

We  assume  that  y^x.O)  =  0  and  that  yi(x,s)  is  nondecreasing  in  s  for 
each  i  and  for  every  x  in  R.  The  total  effort  density  at  x  in  the  first 
j  stages  is 
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(b) 


J 

M  (x)  =  M . (x,s  ) 
i-1 

At  additional  search  time  s  in  the  j t*1  stage,  after  (j  -  1)  false  tar¬ 
gets  have  been  found,  the  total  search  density  at  x  is 


(x,  s)  =  M^U)  +  h  j  (x,  s) 

We  call  attention  to  the  fact  that  (x)  =  mj(x,Sj)  in  our  notation. 
Thus,  capital  M  is  used  for  the  value  of  m  when  contact  occurs.  The 
variable  s  is  used  for  the  additional  search  time;  the  total  search 
time  S  corresponding  to  the  additional  search  time  s  in  the  j1"*1  stage 
is  S  -  sx  +  s2  +  ...  +  Sj_1  +  s. 

The  total  effort  that  has  been  applied  in  the  additional  search  time  s 
in  the  j1"*1  stage  is 


w,(s)  =  M.(x,s)  dx 

J  K  J 


and  the  total  effort  W^(S)  from  the  start  of  search  is 


W.  (S)  -  w  (s)  +  Y,  ”4(84)  > 
J  J  i»l  1  1 


j-1 

+  £  si 

J  *■ 


Then  we  can  impose  the  condition  that  the  effort  in  the  j  stage,  or 
the  total  effort,  is  a  known  function  of  the  search  time.  For  example, 
the  condition  that  effort  is  applied  at  a  known  rate  in  the  j  ^  stage 


<8)  ' s 

We  assume  that  the  conditional  probability  that  a  target  at  x  will  be 
contacted  when  an  effort  of  total  density  m(x)  is  applied  at  x  is  a 
function  b(m(x)),  called  the  local  effectiveness  function  by  Stone  and 
Stanshine,  of  the  total  density  m(x) ,  however  it  is  applied.  We  assume 
that  b (0 )  =  0,  lim  b(u)  =  1  as  u  -*■  »,  and  that  the  derivative  b*  (u)  is 
positive,  continuous,  and  strictly  decreasing.  Some  of  these  properties 
can  be  relaxed  or  omitted  under  some  conditions.  Thus,  the  limit  prop¬ 
erty  is  needed  if  we  assume  that  search  will  continue  until  target  detec¬ 
tion  occurs  when  minimizing  the  expected  time  to  detection,  but  could  be 
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omitted  for  some  other  criteria.  Also,  the  positive  and  strictly  de¬ 
creasing  conditions  on  b' (u)  can  be  replaced  by  non-negative  awd  non- 
increasing  conditions. 


We  obtain  the  conditional  contact  function  at  x  for  the  j ^  stage,  given 
that  the  effort  of  density  Mj_^(x)  was  applied  in  the  first  j  -  1  stages, 
by  using  our  assumption  that  b  is  a  function  of  the  total  density.  Let 


kj(x»s)  =  b (dj (x, s) | Mj_^ (x ) )  =  conditional  probability  that  a 

target  at  x  will  be  contacted  by  the  additional  effort 
of  density  Mj(x,s)  in  the  jth  stage,  given  that  it 
hasn't  been  contacted  by  the  effort  of  density  ^(x) 
that  has  been  applied  in  the  previous  stages. 

Then,  the  total  probability  of  contacting  a  target  at  x  is 

b(dj  (x,s)  +  Mj^Cx))  =  b(Mj_1<x))  +  [1  -  b(M  .^(x))]  bj(x,s), 

from  which  we  can  obtain  b.(x,s).  It  will  be  convenient  to  use  the 

j 

complements  of  b  and  b  .  Let 

J 

A  A 

8(m(x,s))  -  1  -  b (m(x, s) ) ,  8j(x,s)  *  1  -  bj(x,s) 

Then  from  equation  (7)  we  obtain 

„  3 (y  .  (x,s)+M.  .(x)) 


3^ (x,s) 


±11 


eCM^^x)) 


(7) 


(8) 


Let  a(u)  be  the  conditional  contact  failure  function  for  false  targets, 
corresponding  to  g(u)  for  the  target.  Then  the  conditional  contact 

A 

failure  probability  ctj(x,s)  in  the  j  stage  is  obtained  from  the 
equation 


A  a(y  (x,s)+M  (x)) 

aj(X,S)  aft^x)) 


(9) 


4.  Target  and  False  Target  Location  Distributions 

We  start  with  the  target  location  distribution.  For  the  target  there 
are  only  two  stages.  In  the  first  stage  the  number  of  found  targets 
is  zero.  Using  Bayes'  formula,  the  conditional  target  density  function, 
given  that  no  target  has  been  found,  is 
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^(x.s) 


f(x)  ti  ,(ni(x,a)) 

Q(s) 


(10) 


wtiere  m(x,s)  is  the  search  density  at  x  in  time  s,  and 

Q(s)  =/R  f (x)3(m(x,s) )dx  (11) 

In  the  second  stage,  the  conditional  target  density  function,  given 
that  one  target  has  been  found,  is 


f2(x,s)  =  0 


(12) 


Now  consider  false  targets.  If  the  number  n  of  false  targets  is  known, 

there  are  (n-j+1)  unlocated  false  targets  in  the  j1’'1  stage,  j=l , 2 , . . . ,n+l. 

Assume  that  the  n  targets  are  identically  distributed  with  common  prior 

density  function  g(x).  The  conditional  density  function  for  one  residual 

til 

false  target  in  the  j  stage  is 


where 


gj (x,s) 


gCxJaOn^x.s)) 


(13) 


(x» s)  -  +  Pj(x,s)  (6) 

and 

Qj  (s)  -  g(x)a(nij  (x,s))dx  (14) 

The  collective  density  function  of  all  residual  false  targets  in  the 

.  th  .  . 

j  stage  is 


<5j(x,s)  -  (n-j+1)  gj(x,s) 


(15) 


If  the  false  targets  are  identically  distributed  and  the  number  is 
unknown  with  a  known  number  density  probability  p^»  we  replace  the  num¬ 
ber  (n-j+1)  of  known  residual  targets  by  the  expected  number  n^ ,  given 

that  j-1  have  been  found.  From  equation  (1)  we  have 

00 

n.  =  £  k  p 

1  k-1  K 
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L'  kP 


n  .  = 


k=l 


k+J-1 


J  1-PQ-Pf 


■~P 


,  j  =  2,  3, 


(16) 


J-2 


Then  the  expected  value  of  the  collective  density  function  in  the  j 
stage,  given  that  j-1  have  been  found,  is 


.  Lh 


6^ ( x , s )  =  n^  g (x,s) 


(17) 


If  the  false  target  population  contains  two  or  more  a  priori  location 
distributions,  we  treat  each  type  separately,  using  equation  (4)  and 
extensions  of  it  to  get  the  number  distributions.  Then  the  collective 
location  density  function  of  all  residual  false  targets  can  be  obtained 
by  addition  of  the  separate  location  density  functions. 


In  writing  the  collective  density  of  residual  false  targets  in  the 
form  (15)  when  n  is  known,  we  are  making  an  obvious  extension  of  the 
forms  (10)  and  (12)  for  n  =  1.  In  any  particular  stage  the  expected 
number  of  residual  false  targets  remains  constant  as  s  increases;  it 
changes  only  when  an  additional  false  target  is  found  and  we  go  to  the 
next  stage. 


We  have  retained  this  property  in  making  the  extension  to  other  number 
distributions  in  equation  (17) .  We  assume  that  failure  to  contact  a 
false  target,  while  search  proceeds  in  the  j stage,  changes  the  loca¬ 
tion  distribution,  but  not  the  number  distribution,  of  residual  false 
targets.  The  location  distribution  of  a  residual  false  target  is  ob¬ 
tained  from  equation  (13)  and  the  number  distribution  from  equation  (1) . 

Stone  and  Stanshine  [1]  use  the  expected  number  of  false  targets  that 
will  be  contacted,  instead  of  the  observed  number.  They  implicitly 
assume  that  the  expected  density  of  residual  false  targets  at  total 
search  time  S,  when  an  effort  of  total  density  m(x,S)  has  been  applied, 
is 

6(x,S)  =  6  (x)ct(m(x,S))  (18) 
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This  quantity  is  the  expected  density  of  residual  false  targets,  given 
no  information  on  the  number  that  have  been  found .  The  corresponding 
value  of  the  expected  number  of  residual  false  targets  is 


n(S) 


x)a (m(x, S) ) dx  =  n  Q(S), 


(19) 


where  n  is  the  expected  number  initially  in  R  and 


Q (S)  =  /Rg(x)a(m(x,S))dx  (20) 

Thus,  they  use  a  form  that  requires  the  expected  residual  number  n  to 
depend  on  the  total  search  time  but  not  on  the  observed  number  of  false 
targets  that  have  been  found.  It  is  an  expected-value  model. 


5.  Optimization  Criteria 

It  usually  is  assumed  that  the  general  objective  of  the  search  is  to 
find  the  target  quickly.  The  two  precise  criteria  that  are  obtained 
from  this  general  objective  are: 

(1)  To  maximize  the  probability  P(t)  of  finding  the  target 
by  a  given  elapsed  time  t; 

(2)  To  minimize  the  expected  time  to  find  the  target. 

An  objection  that  can  be  raised  to  the  second  criterion  is  that  it 
assumes  implicitly  that  search  will  be  continued  until  the  target  is 
found,  a  condition  that  the  searcher  will  not  always  adhere  to  in  prac¬ 
tice,  even  when  he  accepts  it  as  a  condition  in  planning  the  search. 

When  no  false  targets  are  present  we  can  reconcile  the  two  criteria. 

If  a  search  plan  exists  that  maximizes  P(t)  for  all  t,  it  minimizes  the 
expected  time  to  find  the  target.  Such  a  plan  exists  when  no  false 
targets  are  present.  Of  course,  it  is  much  more  difficult  to  lay  out 
a  practical  search  plan  that  approximates  the  distribution  of  the  ideal 
solution  when  trying  to  maximize  P(t)  for  all  t  than  when  trying  to 
maximize  P(t)  for  a  single  value  of  t. 

When  false  targets  are  present  we  have  no  assurance  that  a  plan  exists 
that  maximizes  P(t)  for  all  t.  Since  the  expected  time  to  investigate 
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the  contact  that  is  t he  lurget  is  independent  of  the  search  plan  (assuming 
that  the  investigation  time  depends  only  on  the  target  location),  we  can 
use  tiie  probability  of  contact  ing  the  target  by  elapsed  time  t.  Let 
(J(s|x,m)  be  the  probability  distribution  function  of  the  search  time  s 
for  a  given  value  x  of  the  time  to  contact  the  target  and  a  search  den¬ 
sity  function  m.  The  probability  of  contacting  the  target  by  search  time 
S  with  the  search  density  function  m(x,S)  is 

=  J*Rf(x)b(m(x,S)dx  (21) 

and  the  probability  of  contacting  the  target  by  time  t,  t  _>.  is 

P0(m,x)  =  f  P. (m,S)G(dS | x ,m)  (22) 

“  S=0  1 

The  expected  time  to  contact  the  target  is 

00  00 

t  (m)  =  f t  dP  (m,t)  =  f  [1-P  (m,t)]dt  (23) 

c  0  z  *'o  L 

In  section  5  of  their  paper  [1]  Stone  and  Stanshine  exhibit  an  example 
for  which  the  search  plan  that  maximizes  the  probability  P(l+h)  of  find¬ 
ing  the  target  by  elapsed  time  1+h,  for  sufficiently  small  h  >  0  (with 
the  investigation  time  T  =  1) ,  does  not  coincide  with  their  search  plan 
that  minimizes  the  integral*  y(m)  that  they  assert  is  the  expected  time 
to  contact  the  target.  They  do  not  write  an  equation  for  the  P(t)  func¬ 
tion  and  the  reader  is  left  to  infer  that  they  mean  the  function  P2(m,t-1) 
that  we  have  introduced  above.  Since  they  obtain  y(m)  by  a  procedure  that 
is  quite  different  from  that  used  to  get  tc(m)  from  P^Cm.x)  above,  it  is 
not  clear  whether  their  example  shows  that  no  plan  maximizes  P2(m,t-1) 
for  all  t,  or  that  y(m)  and  tc(m)  are  different  functionals  of  m.  It 
seems  to  us  that  a  proof  of  the  equation 

t  (m)  =  y(m)  for  all  m 
c 

is  needed  to  complete  the  argument. 

The  integral  y(m)  of  the  Stone  and  Stanshine  paper  is  not  the  y(x,s) 
used  above. 
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To  continue  the  discussion  of  criteria,  let  us  assume  that  there  is  no 
plan  that  maximizes  P(t)  for  all  t.  Is  this  a  sufficient  reason  for  the 
selection  of  the  expected-time  criterion  (2)?  In  addition  to  the  restric¬ 
tion  that  it  imposes  on  the  searcher  to  search  until  the  target  is  found, 
it  also  leads  to  a  difficult  optimization  problem,  as  does  the  probability 
criterion  (1).  For  both  criteria  it  is  necessary  to  look  beyond  the  cur¬ 
rent  stage  of  the  search  to  determine  the  optimal  procedure  for  the  cur¬ 
rent  stage,  as  we  show  below. 


Expected-Time  Criterion 

We  start  with  the  expected-time  criterion  (2),  but  adopt  an  approach  to 
the  problem  that  differs  from  that  used  above  in  writing  equation  (23). 
Our  search  procedure  is  as  follows: 

a.  Search  until  a  contact  occurs,  investigate  the  contact 
until  it  is  identified. 

b.  If  the  contact  is  the  target,  stop  the  search. 

c.  If  the  contact  is  a  false  target,  record  the  location 
and  mark  the  site  so  that  investigation  will  not  be  re¬ 
peated,  should  this  false  target  be  contacted  again. 

Increase  the  number  of  found  false  targets  by  1  and  use 
the  fact  that  a  false  target  has  been  found  and  elimi¬ 
nated  to  adjust  the  number  probability  density  of 
residual  false  targets  and  the  location  distributions 
of  residual  false  targets,  to  the  extent  possible. 

Then  continue  the  search. 

d.  Repeat  the  above  steps  until  the  target  is  found. 


If  the  initial  number  n  of  false  targets  is  known,  the  number  of  residual 

.  th 


false  targets  in  the  j 

Sj 


stage  is  n  -  j  +  1.  Let 
,  th 


=  additional  search  time  in  the  j  stage  at  which  contact 
is  made  in  that  stage; 

th 


Ij  =  time  to  investigate  the  j  contact,  if  false; 
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llj  -  conditional  probability  that  the  j1*'  contact  is  lalse, 
given  that  a  contact  has  occurred  at  x  in  the  i 

J 

s  tage . 


then  the  time  t  to  contact  the  target  is 


Lc  "  Si  +  4l(ll  +  s2  +  M2(12  +  Sj  +  q3(' 


L.et 


Si+1  Sn+1 


=  s  +  q  (1  +  T  ) 

n  n  n  n+1 


+  qn(1n  +  8n+l),-*-)  (2M 


T  =  s  .  +  q  ,(I  ,  +  T  ) 

n-1  n-1  Mn-1  n-1  n 


(25) 


"  Sl+ql(Il+T2) 


Then  t  *  T,  and  the  elapsed  time  t  to  find  the  target  is  t  =  t  +  1, 
cl  c 

where  I  is  the  time  to  investigate  the  contact  that  is  the  target. 


The  expected  time  to  find  the  target  is  t  ■  t  +  I.  Since  I  is  indepen¬ 
dent  of  the  search  plan,  we  minimize  t  .  The  expected  time  t  to  contact 

c  c 

the  target  is  obtained  by  averaging  stage  by  stage  in  equations  (25), 

s  t 

starting  with  the  (n+1)  stage  and  moving  (backwards)  to  the  first 
stage. 


S  L 

In  the  (n+1)  stage  there  are  no  false  targets.  We  find  the  target 
density  function  at  the  start  of  this  stage  from  equations  (10)  and  (11) , 
by  putting  m(x,s)  equal  to  the  total  density  function  M^(x)  at  the  end 
of  the  n^  stage,  where 


M  (x)  =  u. (x,s  ) 
n  i=1  l 


(26) 


st 


Then  the  density  function  at  the  start  of  search  in  the  (n+1)  stage  is 


£n+l(x)  = 


f(x)6(M  (x)) 
_ n  , 


(27) 
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where 


=  Ju  f (x> i 


r  .  (M  (x)  )dx 
k  n 


(28) 


We  now  1 Lnd  the  function  p  , ,(x,s)  that  minimizes  the  expected  value  of 

n+1  ‘ 

k 

which  is  a  solved  problem.  The  optimal  function  p^+^(x,.s)  is  the 

function  p  ,(x,s)  that  minimizes  the  failure  probability  Q  , .  (s)  for 
n+ i  ■  n+I 

all  s,  where 


Vl(s)  =  Vn+l(x)  Hn+l(x’s)dx 

=  Q  1  /f(x)8(p  (x,s)  +  M  (x)  )  dx 

n  R  n+1  n 


(29) 


We  could  have  written  equation  (29)  directly,  without  the  use  of  f 


n+1 


and  8 


n+1* 


Let  Q^+^(s)  be  the  function  Q„_1_1(s)  when  p^.,  has  been  replaced  by  the 


n+1 


optimal  function  p  ,  and  put 


n+1 


OO 


0  xn+l 


n+1 


(s)ds 


(30) 


Then  is  the  minimum  expected  time  to  contact  the  target  in  the 

(n+l)j3t  stage.  From  equations  (26)  and  (29)  it  is  seen  that  Tn+^  is  a 
function  of  the  previous  density  functions  Pj(x,s)  and  the  times  s^  at 
which  previous  contacts  were  made,  j  =  1,  2,  ...  ,  n. 

In  the  nC^  stage  we  minimize  the  expected  time  remaining  to  contact  the 

s  t 

target,  on  the  assumption  that  the  search  procedure  in  the  (n+1)  stage 
will  be  optimal.  Hence,  we  minimize  the  expected  value  of 


s  +  q  (I  +T.)=T(s,y) 
n  nn  n  n+1  n  n  n 


(31) 


That  is,  we  find  the  function  p  (x,s)  that  minimizes  T  (s  ,  p  )  over  s  , 

n  n  n  n  n 

given  that  there  is  one  false  target  and  one  real  target  in  R.  The  ex¬ 
pected  value  is  computed  over  the  probability  distribution  of  the  false 

* 

contact  time  s^,  noting  that  q^  and  Tn+^  (and  possibly  1^)  depend  on 

s  and  p  ,  in  general.  This  is  not  a  solved  problem.  We  have  solved  it 
n  n 

in  special  cases  used  as  examples,  one  of  which  will  be  shown  later. 
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Assume  that  the  above 
value  of  the  expected 
minimize  the  expected 


problem  has  been  solved  and  let  T  be  the  minimum 

n 

value  ot  (s^ ,  y  ).  Then  in  the  (n-1)  stage  we 
value  of 


s  ,  +  q  , (I  +  T*) 
n-1  n-1  n-1  n 


T  .  (s  ,  ,  y  , ) 
n-1  n-1  n-1 


(12) 


This  problem  is  similar  to  the  optimization  problem  in  the  previous  stage, 

except  that  there  now  are  two  false  targets.  Also,  the  functional  form  of 
*  * 

T  is  more  complicated  than  that  of  T  ,  . 
n  r  n+1 


Continuing  in  the  way  outlined  above  we  find  the  functions  y  , (x,s), 

*  *  n+1 
y^(x,s)  ...  ,  y^(x,s),  which  constitute  the  optimal  solution,  in  the  sense 

of  minimizing  the  expected  time  to  find  the  target  when  all  the  available 

*  th 

information  is  used.  The  function  y.(x,s)  in  the  j  stage  may  depend  on 

*  *  *  J 

the  functions  y  ^ ,  y^,  •••  »  anc*  t*ie  contact  times  s^,  s^,  ...  ,  Sj_^ 

in  the  previous  stages.  These  functions  and  times  will  be  known  when 

th  * 

search  is  resumed  in  the  j  stage.  The  optimal  function  y.(x,s)  in  the 

th  ^ 

j  stage  is  found  under  the  assumption  that  search  in  the  later  stages 

will  be  optimal. 


If  the  initial  number  n  of  false  targets  is  not  known  but  has  a  finite 

distribution,  we  can  apply  a  similar  procedure  to  find  the  solution.  If 

s  t 

the  maximum  value  of  n  is  K,  there  are  no  false  targets  in  the  (K+l) 
th 

stage.  In  the  K  stage  the  possible  number  n^  of  residual  false  targets 
is  0  or  1.  If  =  0,  =  0  and  there  are  no  later  stages.  If  n^  =  1, 

the  problem  is  the  same  as  the  problem  when  n  is  known.  We  find  the  ex¬ 
pected  value  of  T^(s^,  y^)  over  the  distribution  of  n^  before  proceeding 
with  the  optimization;  similarly  for  the  other  stages.  Thus,  in  prin¬ 
ciple,  we  can  find  the  optimal  solution  in  (K+l)  steps  by  applying  the 
general  principle  of  Dynamic  Programming. 


If  the  distribution  of  n  is  not  finite,  the  problem  is  more  difficult. 

There  now  is  no  convenient  starting  place.  Although  we  do  not  know  how 
to  solve  this  problem,  there  is  no  reason  to  doubt  that  the  optimal  solu¬ 
tion  will  have  the  same  general  properties  of  the  optimal  solutions  of 
the  problems  discussed  above,  and,  in  particular,  the  following  properties: 
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(a) 


<b) 


*  th 

The  optimal  solution  p  (x,s)  in  the  j  stage,  given  that 
j  -  1  false  targets  have  been  found  and  eliminated,  will 
depend  on  J ,  in  general. 

* 


In  addition,  p  (x,s)  will  depend  on  the  optimal  functions 
*  -t-  J  * 

P^,  t>2»  •••  .  Mj  ^  anc*  the  contact  times  s^,  s^,  ...  >  ^ 

in  the  previous  stages,  in  general. 


The  statement  (a)  above  is  made  to  emphasize  the  fact  that  the  optimal 
solution,  in  the  sense  of  minimizing  the  expected  time  to  find  the  target, 
is  conditional  on  the  number  of  found  false  targets  when  all  the  available 
information  is  used. 


The  function  found  by  Stone  and  Stanshine  for  the  expected-value  model  is 
not  conditional  on  the  number  of  found  false  targets.  By  using  the  ex¬ 
pected  number  of  found  false  targets,  instead  of  the  observed  number,  they 
obtain  a  much  easier  problem  than  the  problem  obtained  with  the  correct 
formulation.  Although  their  function  does  not  minimize  the  expected  time 
to  find  the  target,  it  may  be  useful  as  an  approximation,  provided  a  bound 
on  the  error  can  be  obtained. 


7.  Solution  For  a  Particular  Problem 

We  start  with  a  simple  example  to  show  the  general  procedure  that  is  used 

in  minimizing  T  (p  ,  s  )  in  (31). 
n  n  n 

Example  1. 

Assume  that  R  consists  of  two  disjoint  regions  I  and  II  in  the  plane,  each 
having  Lebesque  measure  1;  the  target  density  function  is  f(x)  =  f^  for 
x  in  I,  f(x)  ■  1  -  f  for  x  in  II;  and  there  is  one  false  target,  known 
to  be  in  region  II.  Assume  that  the  time  required  to  identify  a  contact 
is  1,  that  the  conditional  detection  function  is  b(z)  =  1  -  exp(-z),  and 
that  effort  is  applied  at  a  constant  rate  U  =  1. 

We  search  with  density  function  p^(x,s)  until  a  contact  is  made  at  s  =  s^. 
If  the  contact  is  the  false  target,  we  go  to  the  second  stage  of  the  search 
and  search  with  density  function  v^CxjS),  knowing  there  are  no  false  tar¬ 
gets  remaining.  At  the  start  of  the  second  stage  the  conditional  target 
density  function  has  the  form 
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1 


f  for  x  in  J I 


f.,  (x)  =  f.?  for  x  In  1,  t\,(x)  = 

where  f,  is  independent  of  x,  but  depends  on  and  s^ 
f.,  from  equation  (27)  when  needed.) 


iiie  search  density  function  p,}(x,s)  that  minimizes  the 
time  s  to  contact  the  target  depends  on  the  magnitude 

it  *“ 

p  has  the  form: 


For  0  ^  s  Sq,  m2(x,s)  = 


0  for  x  in  1 


s  for  x  in  II 


For  s  >  sQ,  P2(x,s)  = 


(s  -  Sq)/2  for  x  in  I 


(s  +  Sq)/2  for  x  in  II 


where 


sQ  -  ln(f21-l) 


From  equation  (29)  Q2(s)  for  the  optimal  distribution 

Q*(s)  - 

ui- 2  VJ"  J*2/  °  ^0 

Then 

00 

T2  =  Jo  Q2 (s)ds  =  1  +  f2(2  +  S0) 

* 

(If  needed,  we  can  get  T2  when  f2  >  0.5  by  replacing  f 
above  expression.) 


2  T  v  °  -  °0 
*1/2,,  *  a/2  -s/2  „  ^  „ 


Write  p^(x,s)  in  the  form 

|  y(s)  for  x  in  I 


y1(x,s)  = 
From  equation  (27), 


I  s-y(s)  for  x  in  II 
f2  becomes 
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of  f  .  If  f,  j_  0. 5, 


is 


2  by  1  -  f2  in  the 
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-y  (« 1 ) 

f2  -  t^e  /(VV 


where  is  the  observed  time  at  which  the  first  contact  was  made,  and 

(^(s.y)  =  fje  y  +  (1  -  f^e  b+y  (33) 

Then 

sQ  =  2y(s1)  -  s1  +  In  (f 11-1) 

* 

and  we  now  can  write  T2  in  terms  of  s^  and  y(s^). 

To  write  the  equation  for  T^  in  equation  (31)  we  need  the  conditional 
probability  q^  that  the  first  contact  is  made  on  the  false  target,  given 
that  the  contact  is  made  at  search  time  s^.  The  probability  that  the 
false  target,  known  to  be  in  region  II,  will  not  be  contacted  by  search 
time  s  is 

QF(s,y)  =  e"S+y, 

where  it  is  understood  that  y  *  y(s)  is  a  function  of  s.  The  probability 
that  a  contact  will  occur  by  search  time  s  is 

Pc(s,y)  -  1  -  Q1(s,y)  Qp(s,y) 

We  note  that  P^Cs.y)  is  the  probability  distribution  function  of  s^,  the 
time  of  first  contact.  The  rate  of  making  contact  at  search  time  s  is 


‘c’df  pc<9-r<s»- 

We  can  write  P*  in  the  form 
c 

?;  -  qx  pj.  +  qf 

where 


(34) 


P1  “  1  -  V  PF  "  1  '  QF 

and  the  prime  indicates  total  derivative  with  respect  to  s.  The  two  terms 
in  the  righthand  member  of  equation  (34)  are  the  contact  rates  on  the 
false  target  and  the  target  respectively.  If  the  first  contact  occurs  at 
search  time  s^,  the  conditional  probability  that  the  contact  is  made  on 
the  false  target  is  q^(s^,y(s^) ) ,  where 
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q1(s.y(s))  =  Q^s.yfs))  P|,(s,y(B))/P^(B,y(K)) 

The  time  T^(s^,  u^)  in  equation  (31)  will  be  written  in  the  form 
yCs^)).  Then 

T^s.y)  =  s  +  Pp(s , y)  K  (s,y)/P’(s,y), 

where 

R(s,y)  -  fie_y(2y  -  s  +  4  +  ln^"1-!))  +  2(1  -  f  )e_8+y  (35) 

The  mean  value  of  T^( 31»y(s1))  over  is 

00  OO 

T,(y)  *  f  T  (s,y(s))P' (s,y(s))ds  *  f  F(s ,y (s) ,y ' (s) )ds  (36) 

0  0 

where 

F(s,y,y')  =  G(s,y)  +  y'  H(s,y)  (37) 

and 


G(s,y)  -  QF(s,y)[Q1(s,y)  +  R(s,y)] 

H(s,y)  «  -QF(s,y)  R(s,y) 

We  now  find  y(s)  to  minimize  T^(y)  in  (36).  With  an  integrand  (37)  that  is 
linear  in  y'  the  problem  is  easy  to  solve  by  methods  from  the  Calculus  of 
Variations.  The  necessary  conditions  of  Legendre  and  Weierstrass  are  satis¬ 
fied.  Euler's  necessary  condition  for  an  extremum, 

_d  /  gFN  _  3F  , 
ds  ^9y'  J  9y 

reduces  to  the  condition 


9G  =  9H 
9y  9s 


with  the  integrand  F  in  (37)  that  is  linear  in  y'.  This  equation  reduces 
to  the  equation 


9Q 


*1  + 


9y 


1.3R  3R 
9y  9  s 


(38) 


with  the  simple  form  for  Q  above.  When  the  equations  for  Q.  and  R  in 

F  -L 

(33)  and  (35)  are  used,  equation  (38)  becomes 
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which  becomes 


2  e  =  u  +  3 


with  the  change  of  function, 


.-1 


u  ■  2y  -  s  +  ln(f^  -1) 


(39) 


(40) 


There  are  two  solutions  of  equation  (39).  Let  be  the  positive  solution, 
which  is  approximately  u^  =  0.583.  The  corresponding  solution  of  equation 
(40)  is 


yL(s)  =  y  (s  +  u1  -  lnCf^-l)) 


(41) 


We  now  can  show  that  the  solution  y^(s)  in  equation  (41)  minimizes  the 
integral  T^(y)  in  equation  (36)  by  showing  that  the  second  variation  of 
the  integral  is  non-negative,  which  is  a  form  of  Jacobi's  condition.  The 
second  variation  I"  of  the  integral  is 

i"  -  J  (f  P2  +  2  f  ,  nn'  +  P  ,  ,n'2)ds, 

J0  yy  yy  y  y 

where  n  •  n(s)  is  an  arbitrary  variation  from  y^(s)  that  vanishes  at  the 
end  points.  With  the  F  functional  in  equation  (37)  I"  becomes 

I"  -  4  /  £(l-f1)(3-2y*)  e2y’2s  ^-(^e-0  +  2(l-f1)e2y"2s)nn’  ]ds 

Integrating  by  parts  and  using  the  property  that  n(s)  vanishes  at  0  and  «, 
we  have 

f  (l-y')e2y"2s  n2  ds  -  f  e2y’2s  nn'  ds 
J0  0 

When  we  use  this  equation  to  eliminate  y' ,  the  second  variation  becomes 

i"  -  4  f  [ (l-f , )e2y”2s  n2  -  fie"s  nn'Jds 
J0  1  1 

Again,  integrating  e  nn’  by  parts,  we  obtain 

I"  -  2  /[2(l-f1)e2y'2s  -  fx  e"S]  n2ds 
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for  y  -  y^(s)  in  equation  (41)  I"  reduces  to 

oo 

1"  =  2f.(u  +  2)  f  e~S  n2  ds, 

11 

for  which  I"  0  for  all  n(s),  with  equality  only  for  trivial  n(s). 


With  the  negative  root  of  equation  (39),  I"  is  negative,  since  <  -2. 

The  corresponding  function  y2(s)  maximizes  the  integral  (36).  Of  course, 

it  does  not  maximize  the  expected  time  to  detection,  since  the  minimum 
*  — 
time  T9  is  used  in  finding  T^(y). 


The  function  y  (s)  in  equation  (41)  is  the  unrestricted  minimizing  function. 
1  * 

We  obtain  the  optimal  function  y  (s)  by  imposing  the  restrictions 
* 

0  £  y  (s)  <_  s.  The  optimal  solution  depends  on  the  value  of  f  .  If 
fx  <  (1  +  eUl)_1  =  0.358, 

0,  0  <  s  _<  -  +  In  (f^-1) 


* 

y  = 


j(s  +  -  ln( f  11-1) )  ,  s  >  -  \11  +  In  ( f  11-1) 


1  -1 

If  f1  >  (1  +  e  1  , 


* 

y 


-i 

s  ,  0  <  s  <_  u^  -  In  (f1  -1) 

■|-(s  +  u1  -  lnCf^-l)),  s  >  ux  -  In  (f^-1) 


1  -1 

We  note  that  f£  ■  (1  +  e  )  ,  which  is  less  than  0.5  since  >  0.  This 

outcome  had  been  anticipated  above  in  obtaining  the  solution  in  the  second 
stage.  Also,  we  note  that  s^  ■  u^. 


The  complete 
First  Stage 

For  0  < 


solution 


s 


is  the  following: 

-  ln(f^1-l)|, 

,  for  x  in  I, 

,  for  x  in  II,  if  f^  < 


(1 


1,-1 

+  e  ) 
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s  ,  for  x  in  I, 


I  0  ,  for  x  in  II,  if  f  >  (1  +  e  1)_1 
For  |  -  In ( f  ^ 1 )  j  <  s  <_  s^ 

■|(s  +  -  ln(f^-l))  ,  for  x  in  I 

h  = 

j(s  -  +  ln(f^-l))  ,  for  x  in  II 

U1  -1  *  1 
If  f^  *  (1  +  e  )  ,  the  solution  is  simply  y^  =  ys  for  all  x. 


Second  Stage 


For  0  <  t  <  u 


-  ~1  ’  h2 


0  ,  for  x  in  I 
s  ,  for  x  in  II 


For  s  >  u^, 


^-(s  -  u^),  for  x  in  I 


■j(s  +  u^,  for  x  in  II 


In  the  second  stage  the  total  search  time  is  s.  +  s  and  the  total  effort 

ft  it 

density  function  is  y^(s^)  +  V^C8)  • 


We  start  searching  in  region  II  when  f^  is  less  than  the  critical  value, 
0.358,  and  in  region  I  when  f^  is  greater  than  the  critical  value.  The 
critical  value  has  been  changed  from  0.5  with  no  false  targets  to  0.358 
by  one  false  target  in  region  II. 


8.  Additional  Examples 

We  can  use  the  above  method  to  solve  other  two-cell  problems.  We  have 
performed  the  essential  part  of  the  analysis  for  the  cases  in  which  there 
are  0  and  2  false  targets  in  regions  I  and  II,  and  1  false  target  in  each 
region. 

With  this  background,  we  have  attempted  to  solve  the  two-cell  problem  in 
which  there  is  a  known  number  n  of  identically  distributed  false  targets 
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with  the  common  density  function:  g(x)  -  g^  for  x  in  1,  g(x)  -  1  -  g^ 
for  x  in  II.  We  have  written  the  solution  for  the  (n+l)St  stage,  the 
nC^  stage,  and  the  essential  part  of  the  (n-l)St  stage.  The  general 
form  of  the  solution  is  the  same  as  that  obtained  in  example  1  above, 
with  some  complications.  Thus,  in  the  n^  stage  we  get  an  equation  for 
yn(s)  of  the  same  form  as  that  for  y^(s)  in  equation  (41),  but  u^  (now  u^) 
is  a  root  of  the  equation 

fx(l  -  gl)eU(2eU  -  3  -  u)  -  g^l  -  f^U  -  2eU) , 

which  reduces  to  equation  (39)  when  g^  ■  0,  as  in  example  1.  It  appears 
to  be  possible  to  write  out  the  complete  solution  for  this  example.  The 
solution  will  have  the  simple  form  of  the  solution  in  example  1;  that  is, 
we  search  in  one  region  exclusively  or  we  divide  the  effort  evenly  between 
the  two  regions;  no  other  division  of  the  effort  is  admitted  in  the  optimal 
solution. 

If  the  number  of  false  targets  is  not  known  and  the  distribution  is  known 
and  finite,  the  solution  becomes  more  complicated.  We  have  examined  the 
case  in  which  p^  +  0,  i  0,  pi  ■  0,  i  ^  2.  Again,  the  solution  has  the 
general  form  described  above.  It  appears  to  be  possible  to  write  out  the 
complete  solution  for  the  two-cell  problem  with  a  finite  distribution. 

We  also  have  studied  several  simple  examples  for  which  the  number  distri¬ 
bution  of  false  targets  is  the  Poisson  distribution,  as  assumed  by  Stone 
and  Stanshine  [1].  Although  we  do  not  know  how  to  solve  these  problems, 
it  is  evident  that  the  solution  is  not  the  function  they  obtain  from  their 
expected-value  model,  as  shown  by  the  following  examples: 

Example  2. 

Modify  the  two-cell  example  1  by  assuming  that  the  number  of  false  targets 
is  not  known,  that  the  false  target  density  function  6(x)  is 

<5(x)  *  0  for  x  in  I,  6  (x)  =  1  for  x  in  II 

and  the  number  distribution  has  the  Poisson  probability  density  function 

p^  •  e  Vk!  ,  k  ■  0,  1,  2,  ...  (42) 
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The  expected  number  of  false  targets  Is  1. 


The  Stone  and  Stanshine  function  Is  as  follows: 
If  f. 


1 


1/3,  start  In  region  II. 
1-2  f , 


For  0 


In 


(ft)-  i 


0  ,  for  x  in  I 
s  ,  for  x  in  II 


(A3) 


For  s  >  In 


m 


(ft)- 

{  In  [  ( f +  R(s,f1))/2(l-f1>  ]  ,  for  x  in  I  1 
l In  [  (-  f^  +  R(s,f^))/2f^]  ,  for  x  in  II  ) 


SS 


where  R(s,  =  (f^  +  4f  1  ( 1  -  f^e53)1^2 


If  f^  >  1/3,  start  in  region  I. 


For  0  <  s 


For  s  >  In 


‘ssiL. 

ft)- 


for  x  in  I 
for  x  in  II 


mgS  as  in  equation  (44). 


(44) 


(45) 


If  f^  *  1/3,  divide  the  effort,  as  shown  in  (44),  for  s  >  0. 

We  conjecture  that  the  optimal  solution  does  not  contain  functions  of  the 
form  (44),  and  that  it  involves  only  the  simple  functions  of  the  forms  (43), 
(45),  and  (46)  below,  where  c  is  independent  of  s. 


m 


!s/2  +  c  ,  for  x  in  I  ) 
s/2  -  c  #  for  x  in  II  ) 


(46) 


After  a  false  target  has  been  found,  necessarily  in  region  II,  the  residual 
density  of  false  targets  in  region  II  is 


(1) 


-1 


1-e 


-1 


0.582 
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The  sudden  decrease  in  d  from  1.0  before  the  first  contact  to  0.382  when 
the  search  is  resumed  requires  that  a  search  distribution  of  form  (4 3)  be 
used  for  an  interval  at  the  start  of  the  second  stage,  to  be  followed  by 
a  distribution  of  form  (46). 

We  conjecture  that  the  optimal  solution  has  the  following  form: 

*  * 

There  Is  a  critical  value  of  f  ,  say  f  .  If  f  *-  f  ,  we  start  in  region  II 

1  1  A  1  1 

with  a  distribution  of  form  (43).  If  f  >  f  ,  we  start  in  region  I  with  a 

1  1  (1) 

distribution  of  form  (45).  After  a  search  interval  s  that  depends  on  f. 

*  1 
(and  is  0  for  f^  =  f^)  we  shift  to  a  distribution  of  form  (46).  If  the 

first  contact  is  false,  we  start  the  second  stage  in  region  II  with  a  dis- 

(2) 

tribution  of  form  (43).  After  a  search  interval  s  we  shift  to  a  distri- 

(2) 

bution  of  form  (46).  We  conjecture  that  s  will  not  depend  on  f^,  but  may 

depend  on  the  time  s^  at  which  the  first  contact  was  made.  If  a  second 

false  target  is  found,  we  start  the  third  stage  in  region  II  again.  After 

(3) 

a  search  interval  s  ,  which  does  not  depend  on  f^  but  may  depend  on  s^, 

s  t 

we  shift  to  an  even  division.  After  the  (j-1)  false  target  is  found,  we 

search  in  region  II  for  the  interval  s  ^  before  shifting  to  an  even  divi- 

(2)  (3) 

sion.  We  conjecture  that  the  sequence  s  ,  s  ....  decreases  steadily 
and  has  the  limit  zero. 


Example  3. 

For  the  two  disjoint  regions  of  our  earlier  examples  let  f(x)  be 

SO . 5 ,  for  x  in  I 
0.5,  for  x  in  II 

Assume  that  there  are  two  false  target  distributions,  with  density  func¬ 
tions  as  follows: 


^(x) 


for  x  in  I 
for  x  in  II 


<$2 


0  ,  for  x  in  I 
1  ,  for  x  in  II 


Assume  that  each  distribution  type  has  the  Poisson  distribution  (42),  and 
that  the  assumptions  (a)  (b)  (c)  (d)  made  by  Stone  and  Stanshine  [1]  on 
pages  243  and  244  are  satisfied.  In  particular,  assumption  (c)  states 


25 


Arthur  D  Little  Inc 


that,  It  B^  and  B,;  are  disjoint  regions  (here  regions  i  and  II),  t  tie  num¬ 
bers  A(B^,  s)  and  A(B^,  s)  of  false  targets  contacted  in  B^  and  B^  in 
search  time  s  are  mutually  Independent  random  variables. 

The  Stone  and  Stanshine  function  for  this  example  is 

A  | s/2  ,  for  x  in  I 

mss  -  ) 

\ s/2  ,  for  x  in  II 

Obviously,  this  function  is  not  the  optimal  solution  in  the  second  stage, 
after  one  false  target  has  been  found  and  eliminated.  Suppose  that  the 
first  false  target  is  found  in  region  1.  Then  the  total  false  target 
density  function  changes  from  the  symmetrical  case  before  the  contact  to 
the  function 

A  n .  (  0. 582  ,  for  x  in  I 

6U;(x)  =  / 

(  1.0  ,  for  x  in  II 

when  search  is  resumed.  Since  the  target  density  function  is  the  symmet¬ 
rical  function, 

(  0.5  ,  for  x  in  I 
fUJ(x)  -  < 

v  0.5  ,  for  x  in  II, 

we  start  searching  in  region  I  for  a  non-zero  search  interval  before  re¬ 
turning  to  an  equal  division. 

9.  Probability  Criterion 

In  section  6  above  we  outlined  a  general  procedure  for  the  solution  of 
the  problem  of  minimizing  the  expected  time  to  find  the  target  when  the 
number  n  of  false  targets  is  known  or  has  a  known  finite  distribution. 

In  section  7  we  illustrated  the  procedure  for  a  simple  example.  It  is 
evident  from  the  example  that  the  solution  for  more  general  problems  in 
which  n  is  known  or  has  a  finite  distribution  will  be  complicated,  even 
though  solvable  by  the  general  method  of  section  6.  From  our  discussion 
in  section  8  of  two  simple  problems  in  which  n  has  a  Poisson  distribution 
it  appears  that  the  problem  is  much  more  difficult  for  distributions  of 
n  that  are  not  finite. 


f 
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Is  the  problem  easier  when  we  adopt  the  criterion  (1)  discussed  in  sec¬ 
tion  5  above,  that  of  maximizing  the  probability  of  detection  by  a  given 
time?  We  have  studied  this  problem  and  have  concluded  that  toe  probability 
formulation  also  leads  to  a  difficult  optimization  problem,  one  that  is 
likely  to  be  approximately  as  difficult  as,  and  perhaps  more  difficult  than, 
the  optimization  problem  obtained  from  the  minimization  of  the  expected 
time. 

The  key  to  the  expected-time  formulation  is  the  simple  sequence  (25)  that 

yields  the  time  t  to  contact  the  target.  Then  we  can  minimize  the  ex- 
c 

pected  value  of  the  remaining  time  stage-by-stage.  Similarly,  we  can 
write  the  probability  of  contacting  the  target  in  the  time  remaining  when 
search  is  resumed  in  the  j1"*1  stage.  It  can  be  written  as  the  sum  of  the 
probabilities  of  the  following  success  modes: 

(a)  The  target  is  contacted  in  the  remaining  time  and  this 
contact  occurs  before  a  false  target  has  been  contacted. 

(b)  A  false  target  is  contacted  before  the  target  has  been 
contacted,  and  the  target  is  then  contacted  in  a  later 
stage,  provided  there  is  enough  time  remaining  after 
the  contact  occurs. 

The  probability  of  contacting  the  target  in  the  later  stages  in  mode  (b) 
is  assumed  to  be  maximized.  Mode  (b)  will  not  be  possible  when  the  time 
remaining  is  less  than  the  investigation  time.  Thus,  if  the  investigation 
time  is  a  constant  I,  mode  (b)  can  occur  over  a  time  interval  that  is  I 
less  than  the  time  interval  over  which  mode  (a)  can  occur.  The  integrals 
for  the  probabilities  that  success  will  occur  in  modes  (a)  and  (b)  will 
not  be  over  the  same  interval.  This  difficulty  can  be  avoided  by  assuming 
that  the  investigation  time  has  a  distribution,  such  as  the  exponential, 
that  includes  1=0. 

Again,  optimization  is  made  stage-by-stage  in  the  reverse  direction.  The 
starting  point  is  not  as  definite  as  it  was  for  the  expected-time  formula¬ 
tion.  If  the  investigation  time  is  constant,  we  can  compute  the  maximum 
number  of  false  contacts  that  could  be  investigated  and  thus  obtain  the 
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number  of  the  latest  possible  stage.  In  that  stage  success  In  mode  (b) 
is  impossible.  We  then  write  the  probability  for  mode  (a)  alone,  maximize 
it,  and  start  the  sequence.  If  the  investigation  time  has  an  exponential 
distribution,  we  start  with  the  condition  that  all  false  targets  have 
been  found  and  eliminated;  hence,  success  is  restricted  to  mode  (a). 

Again,  we  maximize  the  probability  of  contacting  the  target  in  the  re¬ 
maining  time,  assuming  no  false  targets;  then  go  to  the  stage  in  which 
there  is  one  false  target;  etc.  This  procedure  is  the  same  as  that  used 
in  the  expected-time  formulation. 

The  above  formulation  was  made  for  the  problem  in  example  1  above,  but 
not  solved.  The  optimization  problem  appears  to  be  at  least  as  difficult 
as  the  optimization  problem  in  example  1. 

10.  Some  Alternatives 

The  probability  criterion  (1)  and  the  expected-time  criterion  (2)  lead  to 
difficult  optimization  problems  for  finite  distributions.  For  distribu¬ 
tions  that  are  not  finite  the  problem  appears  to  be  difficult  to  formulate 
in  such  a  way  that  we  can  attack  it  at  a3 1 .  Are  there  sufficiently  good 
reasons  for  restricting  attention  to  these  two  criteria,  or  should  we  con¬ 
sider  others? 

In  addition  to  the  difficulty  of  the  optimization  problem,  the  expected¬ 
time  criterion  contains  the  implied  assumption  that  search  will  be  con¬ 
tinued  until  the  target  is  found.  Aside  from  the  reluctance  of  the 
searcher  to  continue  a  negative  search  indefinitely,  there  also  is  the 
possibility  in  practice  that  no  target  is  present  in  the  region  R.  We 
seldom  can  be  certain  that  a  target  is  present  under  conditions  in  which 
we  do  not  know  its  location.  Our  assumption  that  there  is  one  and  only 
one  target  is  made  for  convenience. 

For  the  probability  criterion  we  assume  that  the  total  time,  either  to 
contact  the  target  or  to  find  (contact  and  identify)  the  target,  is  speci¬ 
fied.  In  practice,  the  available  time  is  not  known  precisely,  and  it  may 
be  changed  by  such  factors  as  weather  and  conflicting  demands  on  the  forces 
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Involved.  Our  assumption  that  the  available  time  is  known  precisely  is 
made  tor  convenience. 


An  alternative  procedure  is  to  look  for  "acceptable"  criteria  for  which 
the  optimization  can  proceed  stage  by  stage  in  the  forward  direction, 
rather  than  the  backwards  direction  required  with  criteria  (1)  and  (2). 
One  such  possible  criterion  is  the  following: 

(3)  In  each  stage  maximize  the  probability  of  contacting  the  target 
before  contacting  a  false  target. 


With  this  criterion  we  automatically  move  to  the  next  stage  when  failure 
occurs.  In  each  stage  the  conditions  depend  on  the  search  densities  and 
outcomes  for  the  previous  stages,  but  the  optimal  search  density  does 
not  depend  on  expectations  in  future  stages. 


An  objection  to  criterion  (3)  is  that  it  does  not  involve  time  directly, 
and,  in  particular,  makes  no  allowance  for  variations  of  the  investigation 
time  with  position  x.  Assume  that  the  investigation  time  is  a  constant  I. 
If  the  total  time  t  that  can  be  allotted  to  the  operation  is  given,  as  in 
criterion  (1),  we  simply  discontinue  the  search  when  the  remaining  time  is 
I  or  less  at  the  completion  of  an  investigation.  If  the  total  time  that 
can  be  allotted  is  not  specified,  we  assume  that  the  stop-go  decision  is 
made  (at  a  higher  level)  at  the  epochs  at  which  the  investigations  of  con¬ 
tacts  are  completed.  Our  problem  then  is  to  find  the  density  function 
th 


stage  that  maximizes  the  probability  of  contacting  the 
target  before  contacting  a  false  target. 


tu  (x,s)  for  the  j 


We  intend  to  study  criterion  (3),  rather  than  continue  with  the  probability 
and  expected-time  criteria.  We  believe  that  search  plans  based  on  crite¬ 
rion  (3)  will  be  adequate,  and  may  have  some  advantages  over  those  based 
on  criterion  (1)  or  criterion  (2). 


Another  alternative  is  to  look  for  conditions  under  which  the  model  of 
Stone  and  Stanshine  applies,  or  yields  a  good  approximation.  Can  it  be 
applied,  or  modified  to  apply,  to  the  case  in  which  the  number  distribu¬ 
tion  of  false  targets  is  not  known  but  the  location  distribution  is  known? 
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Can  it  be  modified  to  apply  to  the  case  in  which  false  contacts  are  gen¬ 
erated  by  noise,  by  other  random  events  that  affect  the  detecting  instru¬ 
ment,  or  by  moving  real  objects  (such  as  whales)  that  can't  be  identified 
with  certainty.  Of  course,  the  assumption  that  contact  investigation  is 
uninterrupted  would  have  to  be  discarded. 


30 


Arthur  1) little  Inc 


REFERENCES 


[L]  L.  D.  Stone  and  J.  A. 
Contact  Investigation 


Stanshine,  "Optimal  Search  Using  Uninterrupted 
"  SIAM  J.  Appl.  Math.  20  (1971),  pp.  241-263. 


31 


Arthur  l) little  Inc 


